128 research outputs found
Interactive Layout Drawing Interface with Shadow Guidance
It is difficult to design a visually appealing layout for common users, which
takes time even for professional designers. In this paper, we present an
interactive layout design system with shadow guidance and layout retrieval to
help users obtain satisfactory design results. This study focuses in particular
on the design of academic presentation slides. The user may refer to the shadow
guidance as a heat map, which is the layout distribution of our gathered data
set, using the suggested shadow guidance. The suggested system is data-driven,
allowing users to analyze the design data naturally. The layout may then be
edited by the user to finalize the layout design. We validated the suggested
interface in our user study by comparing it with common design interfaces. The
findings show that the suggested interface may achieve high retrieval accuracy
while simultaneously offering a pleasant user experience.Comment: 6 pages, 7 figures, accepted in IWAIT2023, video is here
https://youtu.be/Rddjz5jloJ
Towards Optimal Randomized Strategies in Adversarial Example Game
The vulnerability of deep neural network models to adversarial example
attacks is a practical challenge in many artificial intelligence applications.
A recent line of work shows that the use of randomization in adversarial
training is the key to find optimal strategies against adversarial example
attacks. However, in a fully randomized setting where both the defender and the
attacker can use randomized strategies, there are no efficient algorithm for
finding such an optimal strategy. To fill the gap, we propose the first
algorithm of its kind, called FRAT, which models the problem with a new
infinite-dimensional continuous-time flow on probability distribution spaces.
FRAT maintains a lightweight mixture of models for the defender, with
flexibility to efficiently update mixing weights and model parameters at each
iteration. Furthermore, FRAT utilizes lightweight sampling subroutines to
construct a random strategy for the attacker. We prove that the continuous-time
limit of FRAT converges to a mixed Nash equilibria in a zero-sum game formed by
a defender and an attacker. Experimental results also demonstrate the
efficiency of FRAT on CIFAR-10 and CIFAR-100 datasets.Comment: Extended version of paper https://doi.org/10.1609/aaai.v37i9.26247
which appeared in AAAI 202
Efficient Cross-Device Federated Learning Algorithms for Minimax Problems
In many machine learning applications where massive and privacy-sensitive
data are generated on numerous mobile or IoT devices, collecting data in a
centralized location may be prohibitive. Thus, it is increasingly attractive to
estimate parameters over mobile or IoT devices while keeping data localized.
Such learning setting is known as cross-device federated learning. In this
paper, we propose the first theoretically guaranteed algorithms for general
minimax problems in the cross-device federated learning setting. Our algorithms
require only a fraction of devices in each round of training, which overcomes
the difficulty introduced by the low availability of devices. The communication
overhead is further reduced by performing multiple local update steps on
clients before communication with the server, and global gradient estimates are
leveraged to correct the bias in local update directions introduced by data
heterogeneity. By developing analyses based on novel potential functions, we
establish theoretical convergence guarantees for our algorithms. Experimental
results on AUC maximization, robust adversarial network training, and GAN
training tasks demonstrate the efficiency of our algorithms
Efficient Projection-Free Online Methods with Stochastic Recursive Gradient
This paper focuses on projection-free methods for solving smooth Online
Convex Optimization (OCO) problems. Existing projection-free methods either
achieve suboptimal regret bounds or have high per-iteration computational
costs. To fill this gap, two efficient projection-free online methods called
ORGFW and MORGFW are proposed for solving stochastic and adversarial OCO
problems, respectively. By employing a recursive gradient estimator, our
methods achieve optimal regret bounds (up to a logarithmic factor) while
possessing low per-iteration computational costs. Experimental results
demonstrate the efficiency of the proposed methods compared to
state-of-the-arts.Comment: 15 pages, 3 figure
- …